Apparatus and method for enhancing sound produced by a gaming application

ABSTRACT

A system that incorporates teachings of the present disclosure may include, for example, a computing device having a controller to modify sound produced by a gaming application according to an otological profile of a user. Additional embodiments are disclosed.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.15/158,269, filed May 18, 2016, which is a continuation of U.S.application Ser. No. 14/042,603, filed Sep. 30, 2013 (now U.S. Pat. No.9,364,745), which is a continuation of U.S. application Ser. No.12/558,240, filed Sep. 11, 2009 (now U.S. Pat. No. 8,577,049), which areincorporated herein by reference in their entirety.

FIELD OF THE DISCLOSURE

The present disclosure relates generally to gaming applications, andmore specifically to an apparatus and method for enhancing soundproduced by a gaming application.

BACKGROUND

It is common today for gamers to utilize more than one gaming accessory.This is especially true of gamers who play Massively Multiplayer On-line(MMO) games in a team or individual configuration. Gamers can have attheir disposal accessories such as a keyboard, a general purpose gamingpad, a mouse, a gaming console controller, a headset with a built-inmicrophone to listen to sounds produced by a gaming application and tocommunicate with other players, a joystick, a computer display, or othercommon gaming accessories.

A gamer can frequently use a combination of these accessories in onegame (e.g., headset, a keyboard, and mouse). Efficient management andutilization of these accessories can frequently impact a gamer's abilityto compete.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1A depicts an illustrative embodiment of a Graphical User Interface(GUI) generated by an Accessory Management Software (AMS) applicationaccording to the present disclosure;

FIG. 1B depicts another illustrative embodiment of a GUI generated by anAMS application according to the present disclosure;

FIG. 2 depicts another illustrative embodiment of a GUI generated by anAMS application according to the present disclosure;

FIG. 3 depicts another illustrative embodiment of a GUI generated by anAMS application according to the present disclosure;

FIGS. 4-6 depict illustrative methods describing the operation of theAMS application;

FIG. 7 depicts an illustrative embodiment for detecting sounds accordingto the method of FIG. 6; and

FIG. 8 depicts an illustrative diagrammatic representation of a machinein the form of a computer system within which a set of instructions,when executed, may cause the machine to perform any one or more of themethodologies disclosed herein.

DETAILED DESCRIPTION

One embodiment of the present disclosure entails a computer-readablestorage medium having computer instructions to cause a sequence of aplurality of audio tests to be audibly presented to a user of a gamingapplication, receive a plurality of indications of the user's ability tosense the plurality of audio tests, modify sound produced by the gamingapplication according to the plurality of indications, and present themodified sound.

One embodiment of the present disclosure entails a computing devicehaving a controller to modify sound produced by a gaming applicationaccording to an otological profile of a user.

One embodiment of the present disclosure entails a method operable in agaming application to modify sound produced by the gaming applicationaccording to an otological profile of a user.

FIGS. 1A-1B and 2-3 depict illustrative embodiments of a Graphical UserInterface (GUI) generated by an Accessory Management Software (AMS)application according to the present disclosure. The AMS application canoperate in a computing device such as a desktop computer, a laptopcomputer, a server, a mainframe computer, or a gaming console. A gamingconsole can represent a gaming device such as a Playstation 3™, a Wii™,or an Xbox360™. Other present and next generation gaming consoles arecontemplated. The AMS application can also operate in other computingdevices with less computing resources such as a cellular phone, apersonal digital assistant, or a media player (such as an iPOD™). Fromthese illustrations it would be apparent to an artisan with ordinaryskill in the art that the AMS application can operate in any device withcomputing resources.

FIGS. 4-6 depict illustrative methods 400-600 describing the operationof the AMS application as shown in FIGS. 1-3. Method 400 can begin withstep 402 in which the AMS application is invoked in a computing device.The invocation step can result from a user selection of the AMSapplication from a menu or iconic symbol presented on a desktop of thecomputing device by an operating system (OS) managing operationsthereof. In step 404, the AMS application can detect by way of driversin the OS a plurality of operationally distinct accessoriescommunicatively coupled to the computing device. The accessories can becoupled to the computing device by a tethered interface (e.g., USBcable), a wireless interface (e.g., Bluetooth or WirelessFidelity—WiFi), or combinations thereof.

In the present context, an accessory can represent any type of devicewhich can be communicatively coupled to the computing device and whichcan control aspects of the OS and/or a software application operating inthe computing device. An accessory can represent for example a keyboard,a gaming pad, a mouse, a gaming console controller, a joystick, amicrophone, or a headset with a microphone—just to mention a few. Thekeyboard and gaming pad represent accessories of a similar categorysince their operational parameters are alike.

A mouse, on the other hand, represents an accessory having disparateoperational parameters from the keyboard or gaming pad. For instance,the operational parameters of a keyboard generally consist ofalphanumeric keys, control keys (e.g., Shift, Alt, Ctrl), and functionkeys while the operational parameters of a mouse consist of navigationdata generated by a tracking device such as a laser sensor, buttons toinvoke GUI selections, and settings thereof (e.g., counts or dots perinch, acceleration, scroll speed, jitter control, line straighteningcontrol, and so on). Such distinctions can be used to identify disparatecategories of accessories. The joysticks, game controllers or any otherinput devices represent additional categories of accessories supportedby the AMS.

In step 406, the AMS application can present a GUI 101 such as depictedin FIG. 1 with operationally distinct accessories such as the keyboard108 and mouse 110. The GUI 101 presents the accessories 108-116 in ascrollable section 117. One or more accessories can be selected by auser with a common mouse pointer. In this illustration, the keyboard 108and mouse 110 were selected with a mouse pointer for customization. Uponselecting the keyboard 108 and mouse 110 in section 117, the AMSapplication presents the keyboard 108 and mouse 110 in split windows118, 120, respectively, to help the user during the customizationprocess.

In step 408, the AMS application can be programmed to detect auser-selection of a particular software application such as a game. Thisstep can be the result of the user entering in a Quick Search field 160the name of a gaming application (e.g., World of Warcraft™). Uponidentifying a gaming application, the AMS application can retrieve instep 410 from a remote or local database gaming application actionswhich can be presented in a scrollable section 139 of the GUIrepresented as “Actions” 130. The actions can be tactical actions 132,communication actions 134, menu actions 136, and movement actions 138,or any other types of actions, which can be used to invoke and managefeatures of the gaming application.

The actions presented descriptively in section 130 of the GUI canrepresent a sequence of accessory input functions which a user canstimulate by button depressions, navigation or speech. For example,depressing the left button on the mouse 110 can represent the tacticalaction “Reload”, while the simultaneous keyboard depressions “Ctrl A”can represent the tactical action “Melee Attack”. For ease of use, the“Actions” 130 section of the GUI is presented descriptively rather thanby a description of the input function(s) of a particular accessory.

Any one of the Actions 130 can be associated with one or more inputfunctions of the accessories by way of a simple drag and drop action.For instance, a user can select a “Melee Attack” by placing a mousepointer 133 over an iconic symbol associated with this action. Upondoing so, the symbol can be highlighted to indicate to the user that theicon is selectable. At this point, the user can select the icon byholding the left mouse button and drag the symbol to any of the inputfunctions (e.g., buttons) of the keyboard 108 or mouse 110 to make anassociation with an input function of one of these accessories.

For example, the user can drag the Melee Attack symbol to the rightmouse button thereby causing an association between the selection of theright mouse button and the gaming action of a Melee Attack. When theright button of the mouse 110 is selected during normal operation, theAMS application can detect the selection as a “trigger” to generate thekey sequence “Ctrl A” which is understood by the gaming application asrequest for a Melee Attack. The gaming application receives from the AMSapplication by way of an operating system the “Ctrl A” sequence as if ithad been generated by a Qwerty keyboard.

With this in mind, attention is directed to step 412 where the AMSapplication can respond to a user selection of a profile. A profile canbe a device profile or master profile invoked by selecting GUI button156 or 158, each of which can identify the association of actions withinput functions of one or more accessories. If a profile selection isdetected in step 412, the AMS application can retrieve macro(s) and/orprior associations of actions with the accessories as defined by theprofile. The actions and/or macros defined in the profile can also bepresented in step 416 by the AMS application in the actions column 130of the GUI 101 to modify or create new associations.

In step 418, the AMS application can also respond to a user selection tocreate a macro. A macro in the present context can represent a subset ofactions that can be presented in the Actions column 130. Any commandwhich can be recorded by the AMS application can be used to define amacro. A command can represent a sequence of input functions of anaccessory, identification of a software application to be initiated byan operating system (OS), or any other recordable stimulus to initiate,control or manipulate software applications. For instance, a macro canrepresent a user entering the identity of a software application (e.g.,instant messaging tool) to be initiated by an OS.

A macro can also represent recordable speech delivered by a microphonesingly or in combination with a headset for detection by anothersoftware application through speech recognition or for delivery of therecorded speech to other parties. In yet another embodiment a macro canrepresent recordable navigation of an accessory such as a mouse orjoystick, recordable selections of buttons on a keyboard, a mouse, or amouse pad, and so on. Macros can also be combinations of the aboveillustrations. Macros can be created from the GUI 101 by selecting a“Record Macro” button 148. The macro can be given a name and category inuser-defined fields 140 and 142.

Upon selecting the Record Macro button 148, a macro can be generated byselection of input functions on an accessory (e.g., Ctrl A, speech,etc.) and/or by manual entry in field 144 (e.g., typing the name andlocation of a software application to be initiated by an OS). Once themacro is created, it can be tested by selecting button 150 which canrepeat the sequence specified in field 144. The clone button 152 can beselected to replicate the macro sequence if desired. Fields 152 can alsopresent timing characteristics of the stimulation sequence in the macrowith the ability to customize such timing. Once the macro has been fullydefined, selection of button 154 records the macro in step 420. Therecording step can be combined with a step for adding the macro to theassociable items Actions column 130, thereby providing the user themeans to associate the macro with input functions of the accessories.

In step 422, the AMS application can respond to drag and dropassociations between actions and input functions of the keyboard 108 andthe mouse 110. If an association is detected, the AMS application canproceed to step 424 where it can determine if a profile has beenidentified in step 412 to record the association(s) detected. If aprofile has been identified, the associations are recorded in saidprofile in step 426. If a profile has not been identified in step 412,the AMS application can create a profile in step 428 for recording thedetected associations. In the same step, the user can name the newlycreated profile as desired. The newly created profile can also beassociated with one or more software applications in step 430 for futurereference.

Once the associations have been recorded in the profile, the AMSapplication can proceed to step 432 to determine if the user desires toperform a hearing perceptiveness test. FIG. 1B provides an illustrativeembodiment of a GUI for a performing an audio test, while also providingthe user the ability to adapt the result of each audio test. Step 432can be invoked by selecting GUI button 143 of FIG. 1A with a mousepointer.

In step 434, the AMS application can present a GUI 170 with selectableaudio tests and options to adjust each test independently. Each audiotest (ATn) can present one or more audio tones within a given spectralsegment. In the present illustration, however, an audio test (such asAT1) produces a single audio tone (f₁) to simplify the illustration. TheGUI 170 presents selectable audio tests (ATn) in a menu 171 which can beselected with a mouse pointer.

A user can either select a particular audio test such as AT1 by way ofmenu 171, or the AMS application can sequence between audio tests in apredetermined order, which may or may not be sequential. Once the testis selected, the test can be invoked by selecting the Run Test button.During the hearing test, the user can wear a common audio headset (suchas 114 of FIG. 1A) coupled to a common audio port of the computingdevice from which the AMS application operates. With a headset, the AMSapplication can present an audio test tone in one ear first then theother. The audio tone can be played at a high volume and loweredincrementally or vice-versa as part of a hearing test.

Prior to testing, the AMS application can ask the user to select theleft ear button or the right ear button to indicate which ear the userhas heard a tone. The volume of the test tone can be varied by the AMSapplication to determine the user's hearing range in each ear. Based onthe indications supplied by the user (left/right ear buttondepressions), the results of the audio test of each ear can be presentedby the AMS application in the GUI 170. The intensity required for theuser to hear the audio tone in each ear can be represented by verticalbars for each ear.

The results of the left ear audio test 1 (AT1L) and right ear audio test1 (AT1R) are shown with independent vertical bars 176L and 176R,respectively. The less bars the less audio energy was required for theuser to perceive the audio tone, and vice-versa. In this illustration,the user had more sensitivity in the left ear than the right, which isreflected by the lesser bars for AT1L.

The AMS application can continue with each subsequent audio test (AT2,AT3 . . . ATn) until all tests have been completed. The culmination ofthe of all audio test results can be used to generate in step 436 anotological profile of the user, which identifies in part the user'shearing ability over spectral segments defined by audio tones at variousfrequencies (f1, f2, f3, and so on). The AMS application can stop atthis stage and record the otological profile in step 436 which can thenbe associated to a gaming profile identified in step 412 or in step 428.The otological profile can be later retrieved by the AMS application tomodify sounds generated by a gaming application to enhance the user'sgaming performance as will be described shortly.

In another embodiment, the user can request that the AMS applicationshift sounds near the range of the audio test tone (e.g., +/− 500 Hz inthe range of audio tone f_(n)) for a particular ear which the user hadtrouble hearing to another frequency which the user may be better suitedto perceive sound. This request can be invoked by selecting the FreqShift button while in a particular audio test (e.g., AT1). The AMSapplication can determine, for example, that for audio test AT1 the userperformed poorest in was the right ear.

With this understanding the AMS application can shift a range of soundsnear the frequency of the audio test tone of AT1 (f₁) to anotherfrequency (e.g., f₁ +/− 500 Hz is shifted up or down in frequency to anew target frequency f_(t) which it knows the user can perceive betterin the right ear.) The determination of which frequency to use may beextrapolated from the otological profile, or can be determined by theAMS by retesting the user at a new frequency in one or both ears. Tomaintain symmetry in the frequency shifted sounds, the AMS applicationcan be programmed to apply the frequency adaptation to both ears ratherthan just the affected ear.

To assist the user in determining the desirability of the frequencyshift, the user can select a Sample button which can play sample soundsbefore and after the frequency shift. That is, sounds ranging in f₁ +/−500 Hz can be played unaltered first. The same sounds can then beshifted to the target frequency f_(t) and replayed for the user. If theuser finds the adaptation acceptable, s/he can select the Save FreqShift button; otherwise, the user can select the Cancel Freq Shiftbutton to undo the adaptation. If the user cancels the adaptation, theFreq Shift button can be pressed again and the AMS can try a new targetfrequency which the user can then resample.

In addition to frequency shifting segments of spectral audio content,the user can also be given the option to augment or reduce the audioenergy of each tone. For example, the user can augment or reduce theaudio energy of the f₁ tone by selecting AT1L with the mouse pointer.Once an indication is provided that AT1L has been selected (e.g.,highlighting the AT1L symbol or changing the color of the verticalbars), the user can add more vertical bars, or reduce the number ofvertical bars by dragging the top bar with the mouse pointer up or down,or by selecting keyboard keys such as “+” or “−”. By raising the bars,the user can indicate to the AMS application a desire to augment theaudio energy of sounds in a range of the f₁ tone for the left ear.Similarly, by lowering the bars, the user can indicate to the AMSapplication a desire to reduce the audio energy of the f₁ tone for theleft ear. This technique can be applied to each ear for each audio test.

Once the user is satisfied with the audio tests and perhaps has madeadaptations to the otological profile using frequency shifting or audioaugmentation or reduction as described above, the user can select theDone button which transitions the AMS application from step 434 to 436.In step 436 the original or adapted otological profile is recorded andassociated with a gaming profile as previously described.

The steps of method 400 in whole or in part can be repeated until adesirable otological profile and pattern of associations of actions toinput functions of the selected accessories has been accomplished. Itwould be apparent to an artisan with ordinary skill in the art thatthere can be numerous other approaches to accomplish similar results.These undisclosed approaches are contemplated by the present disclosure.

FIG. 5 depicts a method 500 in which the AMS application can beprogrammed to recognize unknown accessories so that method 400 can beapplied to them as well. Method 500 can begin with step 502 in which theAMS application detects an unknown accessory such as a new keyboard froman unknown vendor by way of a communicative coupling to a computingdevice from which the AMS application operates. The AMS application inthis instance can receive an identity from the keyboard or the operatingsystem which is not known the AMS application. Upon detecting an unknownaccessory, the AMS application in step 504 can present a depiction of anaccessory of similar or same category in response to a user providingdirection as to the type of accessory (by selecting for example adrop-down menu). Alternatively, or in combination with the userinstructions, the AMS application can determine from the informationreceived from the unknown accessory an accessory type.

In step 506 the AMS application can receive instructions describing allor a portion of the input functions of the unknown accessory. Theseinstructions can come from a user who defines each input functionindividually or responds to inquiries provided by the AMS application.The AMS application can for example make an assumption as to thekeyboard layout and highlight each key with a proposed function whichthe user can verify or modify. Once the AMS application has beenprovided instructions in step 506, the AMS application can create anaccessory identity in step 508 which can be defined by the user. Insteps 510 and 512, the AMS application can associate and record theaccessory instructions with the identity for future recognition of theaccessory. In step 514, the AMS application can present a depiction ofthe new accessory with its identity along with the other selectableaccessories in section 117.

Method 500 can provide a means for universal detection andidentification of any accessory which can be used to control or managesoftware applications operating in a computing device.

FIG. 6 depicts a method 600 for illustrating the AMS application while auser is utilizing a gaming application. Method 600 can begin with step601 in which the AMS application retrieves a otological profileassociated with the gaming application selected by the user. In step 602the AMS application can monitor sounds generated by the gamingapplication which it can adjust in step 603 according to the otologicalprofile recorded in step 436. Step 603 can be implemented by the AMSapplication utilizing common sound detection and sound processingtechniques that provide a means to adjust audio energy and frequencyshifting of original gaming sounds as earlier described to enhance theuser's ability to better perceive the sounds in the gaming application.

The AMS application can, for example, digitally sample sound, andtranslate time domain signals to frequency domain signals for processingpurposes utilizing a Fourier transform. By translating between domains,applying common filtering and spectral profile comparison techniques,the AMS application can detect sounds in specific frequency ranges whichit can then adapt according to the otological profile of the user—seeillustration of FIG. 7. By adjusting the audio energy and/or frequencyshifting signals the user has trouble hearing, the user can better hearthe sounds produced by the gaming application, which may improve theuser's performance, and enhance his/her experience.

Steps 601-603 can operate independently of the operations of steps604-626.

Turning attention to step 604, this step can represent monitoring thestimulation of input functions of one or more accessoriescommunicatively coupled to a computing device from which the AMSapplication operates. The input functions can correspond to buttondepressions on a keyboard, gaming pad, or navigation device such as amouse. The input functions can also represent navigation instructionssuch as mouse or joystick movements. The input functions can furtherrepresent speech supplied by a microphone singly or in combination witha headset. Other existing or future input functions of an accessorydetectable by the AMS application is contemplated by the presentdisclosure. The AMS application can monitor input functions by forexample processing human interface device (HID) reports supplied by theaccessories to the computing device.

Once one or more stimulations have been detected in step 604, the AMSapplication can proceed to step 606 to determine if action(s) have beenassociated with the detected stimulation(s). If for example thestimulations detected correspond to keyboard and mouse buttondepressions, the AMS application can determine if actions have beenassociated and recorded for such stimulations. If these stimulations“trigger” one or more actions, the AMS application can proceed to step608 where it retrieves the stimulation definition of these actions foreach accessory reporting a stimulation. In step 610, the AMS applicationcan substitute the detected stimulations with the stimulations definedby the action.

To illustrate this substitution, suppose for example that the detectedstimulation was “Ctrl A” simultaneously depressed on a keyboard. Supposefurther that an action associated with this stimulus consists of a macrothat combines mouse clicks with a navigation of the mouse (e.g., movingthe mouse quickly in a forward motion for a given distance), and arequest to invoke an instant messaging (IM) session with a particularindividual using Skype™ or some other common IM tool. In step 610, theAMS application would substitute “Ctrl A” for stimulations consisting ofthe mouse clicks, navigation and a request for an IM application. Thesubstitute stimulations would then be reported in step 612 to anoperating system (OS).

In step 616, the OS can determine whether to pass the substitutestimulations to an active software application in operation (e.g., agaming application) and/or to invoke another software application. Theactive software application can be operating from the same computersystem from which the OS and the AMS application operate or can beoperating at a remote system such as an on-line server or family ofservers (e.g., World of Warcraft) awaiting stimulation data from thecomputer system. In this illustration, the macro comprises bothstimulation feedback for the active software application and a requestto initiate an IM session. Accordingly, the OS conveys in step 618 themouse stimulation signals to the active software application (e.g.,gaming application), and in a near simultaneous fashion invokes the IMsession in step 620 with a specific individual (or organization).

Referring back to step 606, the illustrations above cover a scenario inwhich the AMS application has detected an association of actions toaccessory stimuli. If however the AMS application does not detect suchan association, then the detected stimulus (or stimuli) supplied by oneor more accessories is transmitted to the OS in step 614. For example,it may be that a stimulation based on the depressions of “Ctrl A” has noparticular association to an action. In this case, the AMS applicationpasses this stimulation to the OS with no substitutes. In step 616 theOS can determine if this stimulation invokes a new software applicationin step 620 or is conveyed to the previously initiated softwareapplication.

Contemporaneous to the embodiments described above, the AMS applicationcan also record in step 622 statistics relating to the detectedaccessory stimulations. A portion of the AMS application can operate asa background process which performs statistical analysis on thestimulations detected. By selecting button 104 in FIG. 1, the AMSapplication can provide an updated GUI which illustrates the usage ofinput functions of one or more accessories for which stimulations weredetected in step 604. For ease of illustration, only a keyboardaccessory is shown. In this illustration, certain keys (references 204,206 208, 210) on the keyboard are color-coded to illustrate thefrequency of usage of these keys.

A color scale 203 defines the frequency of usage of the input functionsof the keyboard. The color scale 203 should not be confused with thecolor scales of FIGS. 1B-1C. The first end of the scale (navy blue)represents a single detected depression, while an opposite end of thescale (bright red) represents 500 detected depressions. Based on thisscale, the AMS application maps by color in step 624 stimulations of thekeyboard. For example, the key grouping 208 depict a color coding withthe highest detectable usage, while the F7 key (reference 210) indicatesthe fewest depressions. Keys having zero depressions are not color codedto readily identify the color mapping of keys which were used at leastonce.

The AMS application provides additional functions in a playback panel ofthe GUI which can help a user understand how the color coded keys wereused during an active software application such as a video game. In thissection of the GUI, the AMS application can present the user with aplayback control function 202 which the user can select to replay,pause, forward or rewind the usage of these keys. When usage playback isselected, the user can for instance see the color coded keys highlightedin real-time with a temporary white border to visualize how the keyswere selected. A time clock 204 provides the user the elapsed time ofthe playback sequence. Button 212 allows the user to retrieve statisticsfrom other sessions, while button 214 provides the user a means to savestatistics from a given session.

The GUI of FIG. 2 could have been shown as a split screen with allaccessories which generated one or more detected stimulations (e.g.,keyboard, mouse, and microphone), each providing statistical symbolicresults as described above for the keyboard. Although not shown, splitscreen embodiments are contemplated by the present disclosure for theGUI of FIG. 2.

In addition to a symbolic representation as shown in FIG. 2, the AMSapplication can provide the user a means to visualize raw statistics ina table format such as shown in FIG. 3 by selecting button 212. Thetable format shows raw data in section 302 and possible suggestions insection 304 for improving user performance which can be generated by theAMS application in step 626. Section 302 can be presented in a tableformat with a column identifying the key being analyzed, its usage, andnumber of key presses. The user can ascertain from this table the mostand least frequently used keys as well as other identifiable patterns.

The AMS application can utilize an understanding of the layout of theaccessory (in this case, the keyboard) to determine from the statisticsways that the user can improve response time or ergonomic use. Forexample, the AMS application can determine from a layout analysis thatthe key combination <Alt.> can be reassigned to a macro based on thetrigger <Ctrl F> which could provide the user a faster response time andfree up the user's right hand for other tasks. The AMS application canalso provide alternative suggestions. For example, the AMS applicationcan also suggest creating single button macros for each of the keycombinations <Alt.> and <Ctrl A> which can be assigned to keys on thekeyboard or left and right buttons of a mouse. The latter suggestion ofassigning macros to the mouse can help the user free up his/her lefthand.

Although not shown in section 304, the AMS application can also beprogrammed to suggest alternative options for the color scales chosen inFIGS. 1B-1C. The AMS application can for example detect that the mostfrequently used keys may lead the user to visualize a color scale betterif it were move to another location of the accessory. For example, thecolor scale of the mouse 110 may be hidden by the user's hand.Accordingly, the AMS application may recommend that the color scale forenemy proximity be move to another accessory such as the keyboard 108 inan area with minimal use (e.g., the keys above the arrows—Delete,Insert, Page Up/Down, and Home, End, etc.).

The AMS application can utilize present and next generation algorithmsto determine how to improve response times and ergonomic usage ofaccessory devices. The AMS application can for example have at itsdisposal an understanding of the layout of each accessory, the type ofsoftware being controlled by the accessory (e.g., World of Warcraft),type of operations commonly used to control the software (e.g., knownactions as shown in the actions column 130 of FIG. 1), an understandingof the associations made by other users (e.g., gamers) to improve theirperformance when controlling the software, and so on. The AMSapplication can also be adapted to communicate with the active softwareapplication by way of an Application Programming Interface (API) toreceive additional usage statistics from the software which it can inturn use to improve the user's performance. The AMS application can alsoutilize common statistical and behavior modeling techniques to predictthe behavior of the user and responses from the software application toidentify possible ways to improve the user's performance.

From these illustrations, it would be apparent to an artisan of ordinaryskill in the art that innumerable algorithms can be developed to analyzeaccessory usage and thereby suggest improvements. These undisclosedembodiments are contemplated by the present disclosure.

From the foregoing descriptions, it would be evident to an artisan withordinary skill in the art that the aforementioned embodiments can bemodified, reduced, or enhanced without departing from the scope andspirit of the claims described below. For example, method 400 can beadapted to define more than one programmable layer for an accessory.Such a feature can extend the functionality of an accessory intomulti-layer paradigms of input functions. The GUI of FIG. 1 can beadapted so that a user can specify more than one programmable layer fora specific accessory.

The user can also specify which layer to present in FIG. 1 whileassociating actions. If for instance layer 1 is shown, the GUI of FIG. 1can present the actions associated in this layer by presentingdescriptors superimposed on the input functions (e.g., buttons or keys).When the user switches to layer 2 (e.g., by selecting from a drop-downmenu the layer of interest) the accessory can be shown in the GUI with adifferent set of associated actions. The user can define a macro oridentify a key sequence to switch between layers when the accessory isin use.

The trigger for switching between layers can be a toggle function (e.g.,selecting the tab key on a Qwerty keyboard) to switch between layers ina round robin fashion (layer 1→layer 2∝layer 3→ to layer 1→ and so on).Alternatively, the user can define a hold and release trigger to switchbetween layers. In this embodiment, the user moves to another layerwhile pressing a button (e.g., a “Shift” key) and returns to thepreceding layer upon its release. In yet another embodiment, the triggerto switch layers can be defined differently per layer. The user can forexample select the letter “A” in layer 1 to proceed to layer 2, andselect the letter “B” in layer 2 to return to layer 1 or proceed to yetanother layer 3. There can be numerous combinations of layers andtriggers which can be defined to substantially expand the capability ofsingle accessory. Additionally, triggers can be of any kind, tactile,speech, etc.

In another embodiment, method 400 can be adapted so that a user candefine super macros and/or super profiles. A super macro can representnested macros (combinations of macros). Method 400 can be adapted sothat the user can customize the timing for executing nested macros.Similarly, a super profile can represent nested profiles (combinationsof profiles). A super profile can for example comprise sub-profiles,each sub-profile defining associations of actions to input functions ofa particular accessory.

In yet another embodiment, the AMS application can be adapted to receivean otological profile from a device other than the computing device fromwhich the AMS application operates. For example, the otological profilecan be generated by a common hearing testing device used by a physician.The hearing test performed by the AMS application can also use advancedtechnologies capable of determining an otological profile of a userwithout user interaction. In yet another embodiment, the AMS applicationcan perform frequency shifting as described earlier automaticallywithout invocation by a user. In another embodiment, the AMS applicationcan be adapted to identify pertinent sounds produced by the gamingapplication (e.g., footsteps, weapon reload, etc.), and adjust theotological profile of the user according to these sounds to enhance theuser's ability to perceive them. The enhancement can be based on achange in audio magnitude, and/or frequency shifting.

In another embodiment, the AMS application can be adapted to operate asan integral part of the gaming application. Accordingly, once actionshave been associated with accessories and an otological profile has beendefined, such settings can be integral to the gaming application. Method600 can then be applied by the gaming application to provide resultssimilar to those described above.

The embodiments of the present disclosure can also be applied tonon-gaming applications which have an interactive user component. Forexample, the disclosed embodiments can be applied to educational toolsthat produce an interactive audio experience (e.g., tools for learningother languages). The present disclosure can also be applied tonon-interactive applications where the user could benefit by adaptingsounds produced thereby according to the user's otological profile.

A super profile can also comprise sub-profiles, each sub-profiledefining an otological profile for a sub-function of a particular gamingapplication. A sub-function can represent for example a selection of anavatar from a list of possible avatars in the gaming application. Forinstance a user of the AMS application can associate a warrior avatarwith a desirable otological profile which can be stored in asub-profile. The user can in the same instance associate a differentotological profile for a military avatar and store this association in adifferent sub-profile. Both sub-profiles can then be stored by the AMSapplication in one super-profile which is associated with the gamingapplication from which the warrior avatar or military avatar isgenerated.

The user can then select the sub-profile prior to initiating the gamingapplication. Responsive to this selection, the AMS application caninvoke the otological profile for the selected sub-profile.Alternatively, when the user selects the warrior avatar or the militaryavatar while the gaming application is in operation, the AMS applicationcan detect the selection by way of an API of the gaming application andautomatically select the sub-profile according to the detected avatarselection.

The foregoing embodiments are a subset of possible embodimentscontemplated by the present disclosure. Other suitable modifications canbe applied to the present disclosure. Accordingly, the reader isdirected to the claims for a fuller understanding of the breadth andscope of the present disclosure.

FIG. 8 depicts an exemplary diagrammatic representation of a machine inthe form of a computer system 800 within which a set of instructions,when executed, may cause the machine to perform any one or more of themethodologies discussed above. In some embodiments, the machine operatesas a standalone device. In some embodiments, the machine may beconnected (e.g., using a network) to other machines. In a networkeddeployment, the machine may operate in the capacity of a server or aclient user machine in server-client user network environment, or as apeer machine in a peer-to-peer (or distributed) network environment.

The machine may comprise a server computer, a client user computer, apersonal computer (PC), a tablet PC, a laptop computer, a desktopcomputer, a control system, a network router, switch or bridge, or anymachine capable of executing a set of instructions (sequential orotherwise) that specify actions to be taken by that machine. It will beunderstood that a device of the present disclosure includes broadly anyelectronic device that provides voice, video or data communication.Further, while a single machine is illustrated, the term “machine” shallalso be taken to include any collection of machines that individually orjointly execute a set (or multiple sets) of instructions to perform anyone or more of the methodologies discussed herein.

The computer system 800 may include a processor 802 (e.g., a centralprocessing unit (CPU), a graphics processing unit (GPU, or both), a mainmemory 804 and a static memory 806, which communicate with each othervia a bus 808. The computer system 800 may further include a videodisplay unit 810 (e.g., a liquid crystal display (LCD), a flat panel, asolid state display, or a cathode ray tube (CRT)). The computer system800 may include an input device 812 (e.g., a keyboard), a cursor controldevice 814 (e.g., a mouse), a disk drive unit 816, a signal generationdevice 818 (e.g., a speaker or remote control) and a network interfacedevice 820.

The disk drive unit 816 may include a machine-readable medium 822 onwhich is stored one or more sets of instructions (e.g., software 824)embodying any one or more of the methodologies or functions describedherein, including those methods illustrated above. The instructions 824may also reside, completely or at least partially, within the mainmemory 804, the static memory 806, and/or within the processor 802during execution thereof by the computer system 800. The main memory 804and the processor 802 also may constitute machine-readable media.

Dedicated hardware implementations including, but not limited to,application specific integrated circuits, programmable logic arrays andother hardware devices can likewise be constructed to implement themethods described herein. Applications that may include the apparatusand systems of various embodiments broadly include a variety ofelectronic and computer systems. Some embodiments implement functions intwo or more specific interconnected hardware modules or devices withrelated control and data signals communicated between and through themodules, or as portions of an application-specific integrated circuit.Thus, the example system is applicable to software, firmware, andhardware implementations.

In accordance with various embodiments of the present disclosure, themethods described herein are intended for operation as software programsrunning on a computer processor. Furthermore, software implementationscan include, but not limited to, distributed processing orcomponent/object distributed processing, parallel processing, or virtualmachine processing can also be constructed to implement the methodsdescribed herein.

The present disclosure contemplates a machine readable medium containinginstructions 824, or that which receives and executes instructions 824from a propagated signal so that a device connected to a networkenvironment 826 can send or receive voice, video or data, and tocommunicate over the network 826 using the instructions 824. Theinstructions 824 may further be transmitted or received over a network826 via the network interface device 820.

While the machine-readable medium 822 is shown in an example embodimentto be a single medium, the term “machine-readable medium” should betaken to include a single medium or multiple media (e.g., a centralizedor distributed database, and/or associated caches and servers) thatstore the one or more sets of instructions. The term “machine-readablemedium” shall also be taken to include any medium that is capable ofstoring, encoding or carrying a set of instructions for execution by themachine and that cause the machine to perform any one or more of themethodologies of the present disclosure.

The term “machine-readable medium” shall accordingly be taken toinclude, but not be limited to: solid-state memories such as a memorycard or other package that houses one or more read-only (non-volatile)memories, random access memories, or other re-writable (volatile)memories; magneto-optical or optical medium such as a disk or tape; andcarrier wave signals such as a signal embodying computer instructions ina transmission medium; and/or a digital file attachment to e-mail orother self-contained information archive or set of archives isconsidered a distribution medium equivalent to a tangible storagemedium. Accordingly, the disclosure is considered to include any one ormore of a machine-readable medium or a distribution medium, as listedherein and including art-recognized equivalents and successor media, inwhich the software implementations herein are stored.

Although the present specification describes components and functionsimplemented in the embodiments with reference to particular standardsand protocols, the disclosure is not limited to such standards andprotocols. Each of the standards for Internet and other packet switchednetwork transmission (e.g., TCP/IP, UDP/IP, HTML, HTTP) representexamples of the state of the art. Such standards are periodicallysuperseded by faster or more efficient equivalents having essentiallythe same functions. Accordingly, replacement standards and protocolshaving the same functions are considered equivalents.

The illustrations of embodiments described herein are intended toprovide a general understanding of the structure of various embodiments,and they are not intended to serve as a complete description of all theelements and features of apparatus and systems that might make use ofthe structures described herein. Many other embodiments will be apparentto those of skill in the art upon reviewing the above description. Otherembodiments may be utilized and derived therefrom, such that structuraland logical substitutions and changes may be made without departing fromthe scope of this disclosure. Figures are also merely representationaland may not be drawn to scale. Certain proportions thereof may beexaggerated, while others may be minimized. Accordingly, thespecification and drawings are to be regarded in an illustrative ratherthan a restrictive sense.

Such embodiments of the inventive subject matter may be referred toherein, individually and/or collectively, by the term “invention” merelyfor convenience and without intending to voluntarily limit the scope ofthis application to any single invention or inventive concept if morethan one is in fact disclosed. Thus, although specific embodiments havebeen illustrated and described herein, it should be appreciated that anyarrangement calculated to achieve the same purpose may be substitutedfor the specific embodiments shown. This disclosure is intended to coverany and all adaptations or variations of various embodiments.Combinations of the above embodiments, and other embodiments notspecifically described herein, will be apparent to those of skill in theart upon reviewing the above description.

The Abstract of the Disclosure is provided to comply with 37 C.F.R. §1.72(b), requiring an abstract that will allow the reader to quicklyascertain the nature of the technical disclosure. It is submitted withthe understanding that it will not be used to interpret or limit thescope or meaning of the claims. In addition, in the foregoing DetailedDescription, it can be seen that various features are grouped togetherin a single embodiment for the purpose of streamlining the disclosure.This method of disclosure is not to be interpreted as reflecting anintention that the claimed embodiments require more features than areexpressly recited in each claim. Rather, as the following claimsreflect, inventive subject matter lies in less than all features of asingle disclosed embodiment. Thus the following claims are herebyincorporated into the Detailed Description, with each claim standing onits own as a separately claimed subject matter.

What is claimed is:
 1. A method comprising: detecting, by a systemcomprising a processor, a selection of a gaming application, wherein theselection is initiated by equipment of a user of the system; retrievingan otological profile associated with the gaming application, whereinthe otological profile associated with the gaming application includes aplurality of sub-profiles, wherein each of the plurality of sub-profilesdefines an otological sub-profile for a sub-function of the gamingapplication; detecting a gaming sound generated by the gamingapplication in a specific spectral segment identified in the otologicalprofile associated with the gaming application, wherein the otologicalprofile is generated from a hearing test performed by the user andassociated with the gaming application; adjusting the gaming sound inaccordance with the otological profile to provide an adjusted sound,wherein the adjusted sound has a frequency different from that of thegaming sound; and audibly presenting the adjusted sound.
 2. The methodof claim 1, wherein each of the plurality of sub-profiles corresponds toa selection of an avatar from a list of possible avatars in the gamingapplication.
 3. The method of claim 1, wherein the gaming applicationexecutes on a game device integral with or communicatively coupled withthe system.
 4. The method of claim 1, wherein the gaming soundrepresents a first avatar of a plurality of avatars in the gamingapplication, and the adjusting the gaming sound comprises adjusting thegaming sound in accordance with a first sub-profile of the plurality ofsub-profiles, wherein the first sub-profile corresponds to the firstavatar.
 5. The method of claim 1, wherein the adjusted sound has anaudio energy different from that of the gaming sound.
 6. The method ofclaim 1, wherein the adjusting further comprises: sampling the gamingsound to obtain a first time domain signal; translating the first timedomain signal to a frequency domain signal; processing the frequencydomain signal to obtain a processed signal according to the otologicalprofile associated with the gaming application; and translating theprocessed signal to a second time domain signal to obtain the adjustedsound.
 7. The method of claim 1, further comprising associating adifferent avatar with each sub-profile of the plurality of sub-profilesof the otological profile.
 8. The method of claim 1, wherein a firstotological sub-profile of the plurality of sub-profiles and a secondotological sub-profile of the plurality of sub-profiles are associatedwith a first avatar and a second avatar respectively, and whereinadjusting the gaming sound comprises adjusting the gaming sound for thefirst avatar in accordance with the first otological sub-profile andadjusting the gaming sound for the second avatar in accordance with thesecond otological sub-profile.
 9. The method of claim 8, furthercomprising storing the first otological sub-profile and the secondotological sub-profile.
 10. The method of claim 1, wherein the hearingtest is performed using a device other than the system.
 11. A devicecomprising: a memory storing instructions; and a controller coupled tothe memory, wherein the controller, responsive to executing theinstructions, performs operations comprising: detecting a selection of agaming application, wherein the selection is initiated by equipment of auser of the device; retrieving an otological profile associated with thegaming application, wherein the otological profile associated with thegaming application includes a plurality of sub-profiles, wherein each ofthe plurality of sub-profiles defines an otological sub-profile for asub-function of the gaming application; detecting a gaming soundgenerated by the gaming application in a specific spectral segmentidentified in the otological profile associated with the gamingapplication, wherein the otological profile is generated from a hearingtest performed by the user and associated with the gaming application;adjusting the gaming sound in accordance with the otological profile toprovide an adjusted sound, wherein the adjusted sound has a frequencyand an audio energy different from that of the gaming sound; and audiblypresenting the adjusted sound.
 12. The device of claim 11, wherein: thedetecting the gaming sound comprises detecting the gaming sound from afirst sub-function of the gaming application; and the adjusting thegaming sound comprises adjusting the gaming sound in accordance with afirst sub-profile of the plurality of sub-profiles, wherein the firstsub-function is associated with the first sub-profile.
 13. The device ofclaim 11, wherein the adjusting further comprises: sampling the gamingsound to obtain a first time domain signal; translating the first timedomain signal to a frequency domain signal; processing the frequencydomain signal to obtain a processed signal according to the otologicalprofile associated with the gaming application; and translating theprocessed signal to a second time domain signal to obtain the adjustedsound.
 14. The device of claim 11, wherein the operations furthercomprise associating different avatar with each sub-profile of theplurality of sub-profiles of the otological profile.
 15. The device ofclaim 11, wherein a first otological sub-profile of the plurality ofsub-profiles and a second otological sub-profile of the plurality ofsub-profiles are associated with a first avatar and a second avatarrespectively, and wherein the adjusting the gaming sound comprisesadjusting the gaming sound for the first avatar in accordance with thefirst otological sub-profile and adjusting the gaming sound for thesecond avatar in accordance with the second otological sub-profile. 16.A non-transitory machine-readable storage medium, comprising executableinstructions which, responsive to being executed by a processor of asystem, cause the processor to perform operations comprising: detectinga selection of a gaming application, wherein the gaming applicationexecutes on a game device integral with or communicatively coupled withthe system; wherein the selection is initiated by equipment of a user ofthe system; retrieving an otological profile associated with the gamingapplication, the otological profile including a plurality ofsub-profiles, wherein each of the plurality of sub-profiles isassociated with one of a plurality of sub-functions of the gamingapplication; detecting a gaming sound generated by the selected softwaregaming application in a specific spectral segment identified in theotological profile associated with the gaming application, wherein theotological profile is generated from a hearing test performed by theuser and associated with the gaming application; adjusting the gamingsound in accordance with the otological profile to provide an adjustedsound, wherein the adjusted sound has a frequency different from that ofthe gaming sound; and audibly presenting the adjusted sound.
 17. Thenon-transitory machine-readable storage medium of claim 16, wherein eachof the plurality of sub-functions of the gaming application correspondsto a different avatar in the gaming application, and wherein theadjusting the gaming sound comprises adjusting a first gaming soundcorresponding a first avatar according to a first sub-profile andadjusting a second gaming sound corresponding to a second avataraccording to a second sub-profile.
 18. The non-transitorymachine-readable storage medium of claim 16, wherein the hearing test isperformed by the processor of the systems.
 19. The non-transitorymachine-readable storage medium of claim 16, wherein the adjustingfurther comprises: sampling the gaming sound to obtain a first timedomain signal; translating the first time domain signal to a frequencydomain signal; processing the frequency domain signal to obtain aprocessed signal according to the otological profile associated with thegaming application; and translating the processed signal to a secondtime domain signal to obtain the adjusted sound.
 20. The non-transitorymachine-readable storage medium of claim 16, further comprisingassociating a different avatar with each of the plurality ofsub-profiles of the otological profile.